Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: add e2e smoke test #507

Open
wants to merge 22 commits into
base: master
Choose a base branch
from
Open

Conversation

jenniferarnesen
Copy link
Collaborator

@jenniferarnesen jenniferarnesen commented Apr 30, 2024

Run the smoke test before running the entire suite to reduce failing runs due to login or settings problems. The actual changes are here (rest of e2e-prod is exact copy from the shared workflow):
https://github.com/dhis2/line-listing-app/pull/507/files#diff-3de8e35d5b45d4311c2d0938f1dc140bfc8f5162e23f4fc4ef3262de605f5408R98-R116

Note that the smoke test runs both in the e2e smoke step and the e2e step. This could be prvented by using subfolders under the /integration folder, and setting the spec property for both Run e2e smoke step and Run e2e test step. I didn't do this because the smoke suite is so small and doesn't add much to the total running time.

Here you can see that the full suite of tests doesn't run when the smoke tests fail:
image

For now I've copied the shared workflow to LL to try out the new smoke step. If it seems useful then we can update the shared workflow.

@jenniferarnesen jenniferarnesen requested a review from a team as a code owner April 30, 2024 11:44
@dhis2-bot
Copy link
Contributor

dhis2-bot commented Apr 30, 2024

🚀 Deployed on https://pr-507.line-listing.netlify.dhis2.org

@dhis2-bot dhis2-bot temporarily deployed to netlify April 30, 2024 11:46 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify April 30, 2024 12:43 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify April 30, 2024 13:03 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify April 30, 2024 14:16 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify April 30, 2024 14:40 Inactive
@jenniferarnesen jenniferarnesen changed the title chore: add e2e smoke job chore: add e2e smoke test Apr 30, 2024
@dhis2-bot dhis2-bot temporarily deployed to netlify April 30, 2024 15:23 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 2, 2024 08:14 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 2, 2024 09:07 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 2, 2024 10:59 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 3, 2024 11:30 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 6, 2024 08:29 Inactive
@jenniferarnesen jenniferarnesen added the e2e record Apply this label to a pull request to trigger recording of E2E tests on Cypress Cloud label May 6, 2024
@dhis2-bot dhis2-bot temporarily deployed to netlify May 6, 2024 12:18 Inactive
Copy link

cypress bot commented May 6, 2024

312 failed tests on run #2696 ↗︎

312 269 3 120 Flakiness 0

Details:

Merge 5aa7637 into 385feee...
Project: line-listing-app Commit: a016971da1 ℹ️
Status: Failed Duration: 34:16 💡
Started: May 6, 2024 2:17 PM Ended: May 6, 2024 2:51 PM
Failed  conditions/numericConditions.cy.js • 17 failed tests • e2e-chrome-parallel-2.39

View Output Video

Test Artifacts
number conditions (event) > equal to Test Replay Screenshots Video
integer > integer with negative value Test Replay Screenshots Video
preset options > set only Test Replay Screenshots Video
numeric types > E2E - Number has all operators Test Replay Screenshots Video
numeric types > E2E - Number can be used in a visualization Test Replay Screenshots Video
numeric types > E2E - Unit interval has all operators Test Replay Screenshots Video
numeric types > E2E - Unit interval can be used in a visualization Test Replay Screenshots Video
numeric types > E2E - Percentage has all operators Test Replay Screenshots Video
numeric types > E2E - Percentage can be used in a visualization Test Replay Screenshots Video
numeric types > E2E - Integer has all operators Test Replay Screenshots Video
The first 10 failed tests are shown, see all 17 tests in Cypress Cloud.
Failed  conditions/alphanumericConditions.cy.js • 15 failed tests • e2e-chrome-parallel-2.39

View Output Video

Test Artifacts
text conditions (event) > exactly Test Replay Screenshots Video
alphanumeric types > E2E - Text has all operators Test Replay Screenshots Video
alphanumeric types > E2E - Text can be used in a visualization Test Replay Screenshots Video
alphanumeric types > E2E - Letter has all operators Test Replay Screenshots Video
alphanumeric types > E2E - Letter can be used in a visualization Test Replay Screenshots Video
alphanumeric types > E2E - Long text has all operators Test Replay Screenshots Video
alphanumeric types > E2E - Long text can be used in a visualization Test Replay Screenshots Video
alphanumeric types > E2E - Email has all operators Test Replay Screenshots Video
alphanumeric types > E2E - Email can be used in a visualization Test Replay Screenshots Video
alphanumeric types > E2E - Username has all operators Test Replay Screenshots Video
The first 10 failed tests are shown, see all 15 tests in Cypress Cloud.
Failed  save.cy.js • 7 failed tests • e2e-chrome-parallel-2.39

View Output Video

Test Artifacts
rename > replace existing name works correctly Test Replay Screenshots Video
rename > add non existing description works correctly Test Replay Screenshots Video
save > new AO with name saves correctly (event) Test Replay Screenshots Video
save > new AO with sorted table saves correctly Test Replay Screenshots Video
save > new AO saves correctly after adding/removing sorting Test Replay Screenshots Video
save > new AO without name saves correctly Test Replay Screenshots Video
save > "save" a copied AO created by others works after editing Test Replay Screenshots Video
Failed  layout.cy.js • 3 failed tests • e2e-chrome-parallel-2.39

View Output Video

Test Artifacts
layout > expansion caret can be toggled Test Replay Screenshots Video
layout > the layout panel can be toggled by clicking the option in the view menu Test Replay Screenshots Video
layout > the layout panel can be toggled by clicking the fullscreen button Test Replay Screenshots Video
Failed  yourDimensions.cy.js • 2 failed tests • e2e-chrome-parallel-2.39

View Output Video

Test Artifacts
Your dimensions > can be used and filtered Test Replay Screenshots Video
Your dimensions > list lazy loads Test Replay Screenshots Video

The first 5 failed specs are shown, see all 86 specs in Cypress Cloud.

Review all test suite changes for PR #507 ↗︎

@dhis2-bot dhis2-bot temporarily deployed to netlify May 6, 2024 13:12 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 6, 2024 14:11 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 8, 2024 12:54 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 8, 2024 13:15 Inactive
@jenniferarnesen jenniferarnesen removed the e2e record Apply this label to a pull request to trigger recording of E2E tests on Cypress Cloud label May 8, 2024
@dhis2-bot dhis2-bot temporarily deployed to netlify May 8, 2024 13:22 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 8, 2024 13:45 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify May 13, 2024 08:39 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify December 4, 2024 09:24 Inactive
@dhis2-bot dhis2-bot temporarily deployed to netlify December 5, 2024 12:43 Inactive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants